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It seems to me that there are two general strategies available to 
an investigator who seeks to inquire into a given set of phenomena, which 
I shall characterize as essentially experimental, manipulat i ve, and inter- 
ventiontst, on the one hand, and aexper imental , observational, and laissez 
faire, on the other. Hard sciences such as physics and chemistry are 
typically experimental, although not always so, as is illustrated by the 
case of astronomy. Social sciences have usually attempted to use the 
former experimental strategy, perhaps in emulation of the modal physical 
science practice; this tendency is especially noticeable in experimental 
psychology. Many social science inquiries have relied on the latter 
aexperimental strategy, however, since, as in the case of astronomy, the 
phenomena under study simply do not lend themselves to experimental or 
manipulative approaches. It shall be my major thesis In this paper that 
the aexperimental strategy rather than the experimental strategy is 
particularly suited to inquiries in the area of educational change. To 
make this point I shall first attempt to delineate the two available 
strategies more closely ( shall then propose a conceptual paradigm 
for thinking about the change process, and, within the Tramework of this 
paradigm, give the reasons why the aexperimental strategy Is to be pre- 
ferred I shall close the paper with a series of illustrations of tactics 
which might be used in pursuing the^ aexper imenta I strategy in order to 
build some conviction that Is operational and empirically meaningful. 
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Major Differences Between Experimental 
and Aexper imenta I Inquiry 



As Roger Barker notes in his presentation on ecological psychology 
which appears in a recent number of the American Psychologist ,* empirical 
phenomena occur without benefit of intervention by an investigator- Data 
relating to those phenomena, however, are always the product of some kind 
of interaction between the phenomena and the investigator. Barker suggests 
that two kinds of interaction are possible, which I will equate, possibly 
erroneously, with the two general strategies to which I alluded a moment ago 
In the first case, which I have labeled "aexper imenta 1" and which Barker 
calls "Type T," the relationship between phenomena and data is transitive, 
i.e., the data simply Rgss through the investigator whose only contribution 
consists of certain transformations which he makes to render the data into 
coded form, so that they may be analyzed at the investigator's convenience 
at some other time. In the second case, which I have labeled "experimental" 
and which Barker calls "Type 0," the relationship is looping, in that the 
investigator becomes an integral part of the data through intervention. 

T systems produce "data" which denote a world the /Tnvest igatoTZ did not 
make in any respect; they signal behavior and its conditions, in situ ." 

On the other hand, the crucial feature of /O systemp" is that by becoming 
involved as an operator in the units he is investigating, the /Invest igatoTZ 
achieves control which allows him to focus upon segments and processes of 



*Roger G. Barker, "Explorations in Ecological Psychology '• Anierican 
Psychologist , 20 (1965), 1-14. 
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particular concern to him, via data that refer to events which he, in part, 
contrives. The essence of T systems is that they are natural and uncontrived 
while the essence of ^ systems is that they are controlled and manipulated. 

To illustrate the difference between these two modes, Barker gives an 
example of frustration research in children which I should like to quote. 

He says: 



Some years ago, when I was a student of Kurt Lewin, 
he and Tamara Oembo and I carried out some experiments 
on frustration. The findings of these experiments have 
been verified by others and they have become a part of 
the literature of scientific psychology. The experiments 
provided basic information about the consequences for 
children of frustrations, as defined in the experiments, 
and about the processes that produce these consequences. 

Time passed. In due course had a student, and he under- 
took to study frustration. So far, so good! All In the 
grund tradition.' My student, Clifford L. Fawl, did not 
replicate the ear I ier study; he did not contr i ve frustra- 
tion for his subjects; he pioneered, and extended the inves- 
tigation from children in vitro , so to speak, to children 
situ . He searched our specimen records of children's 
everyday behavior for instances of this allegedly important 
phenomenon without psychologists as operators. Here are 
the words of his report: 

The results. , . were surprising in two 
respects. First, even with a liberal inter- 
pretation of frustration fewer incidents were 
detected than we expected. . . Second, . . 
meaningful relationships could not be found 
between frustration . . . and consequent be- 
havior such as regression ... and 

other theoretical ly meaningful behavioral 
man i festat ions . 

In other words, frustration was rare in the children's 
days, and when it did occur it did not have the behav- 
ioral consequences observed in the laboratory. It 
appears that the earlier experiments simulated frustra- 
tion very well as we defined it and prescribed it for 
our subjects (in accordance with our theories); but 
the experiments did not simulate frustrations as life 
prescribes it for our children.^ 
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If we were to take a naive* point of view with respect to this example 
of Barker's, we might pose the question^ "Which of the two sets are the 
'real' data?" But to argue for one over the other would be fruitless, since 
obviously both provide certain klhds of Information. The choice between the 
two fnodes that any particular Investigator might make depends, I wi 11 assert, 
largely upon his Intent . The intent of the experimental Investigator, 1 
suggest, Is one of inquiring Into possibilities ^ while the intent of the 
aexper imental Investigator is to inquire Into actualities . ^ jhe basic 
question of the experimentalist is. "What would happen if . . while the 
basic question of the aexper imental i st is, "What does happen in the real 
world?" Thus the experimentalist selects on an a priori basis the variables 
which he wishes to relate, and then arranges a controlled situation so that 
the effects of other variables are eliminated or at least randomized Under 
these conditions he can investigate various aspects of the selected variables 
regardless of whether such aspects or levels are ever likely to be found in 
nature. The aexper imental i st , on the other hand, may be unsure of the varia- 
bles that are relevant to the problem of interest to him, or, even given that 
he can identify the crucial variables, is not interested in studying them in 
any form except as they do in fact occur naturally. This distinction between 
Investigating possibilities vs. actualities is a crucial one that must be 
borne in mind in any discussion of inquiry. 

Generally speaking, our habits of scientific thought predispose 
us heavily to the experimental mode. We are accustomed to thinking that 



I am indebted to Dr. Lawrence Schlesinger of George Washington 
University for drawing my attention to this distinction. 
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exper imenta) control Is absolutely essential if unconfounded data are to 
emerge. In part we feel this way because we have come to take the physical 
sciences as our model of scientific inquiry. We have also tended to accept 
as the ideal social science model the methods of psychology, which are also 
heavily experimental. This ingrained point of view causes us to ask, "Why 
be satisfied with less then the most rigorously defined and controlled data 
generating systems?" Why^ asks Barker, should we bother with "the motley class 
of methods variously called field methods^ naturalistic approaches, observa- 
tional techniques," when whatever it is that they do, laboratory experiments 
can do it with greater precision? 

The answer to this question of course is that these two methods by no 
means produce comparable data. Aexper imental methods are not simply poor 
patched-jp imitations of "real research " Each method complements 
the other, and does things which the other cannot do Experimental methods 
cannot provide data unaltered by the system generating them; they are in- 
evitably tinged by a laboratory bias . Aexper imental methods, on the other 
hand, cannot focus unequi vocal ly upon particular variables which interest 
the investigator nor trace clear cause-effect relations between them; such 
investigations are Inevitably cast within a complex and unresolved situational 
matrix and yield data of an essentially probabal i st ic nature 

There are other points of difference than the intent of the investigator 
between experimental and aexper imental methods which deserve attention, and I 
will list several of these briefly 

1. Sett i nq . Generally speaking, experimental inquiries are pursued 

) 

i.e., in contrived laboratory settings, while aexper imental in- 
quiries are pursued in situ I e wherever they happen to be found. 
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Level of control. Experimental settings require that conditions 
of c o ntrol be established over all variables. Possible confounding varia- 
bles (I.e , all variables other than those of Interest) are either deliber- 
ately controlled, as through a matching process, or randomized. The ran- 
domization process, Indeed, Is the basis for the generation of an error- 
estimate which Is the criterion by which the significance of other data 
are judged. Aexper Imental settings not only tend to ml 1 1 tate against the 
establishment of similar controls by their very nature, but Indeed, In many 
Instances, the Intent of the Investigator Is such that conditions of Invited 

erence ai -0 deliberately sought. In this way the investigator can gain 

insights Into what happens In the worst of all possible worlds, rather than 
I n the best . 

3. Scope . Because experimental Inquiry Is deliberately focussed, Its 
scope may be described as molecular while the scope of aexper imental inquiry 
Is broader and may be described as molar . 

4. Number of variables . Experimental Inquiry Is concerned with a 
sharply limited number of variables (even In so-called multivariate designs), 
while aexper Imental Inquiry must necessarily Involve any variables which 
nature sees fit to Intrude upon It. 

5. Tr^tments. The term treatments Is used here In the conventional 
research sense as a combination of variable conditions to which the subjects 
will be exposed. In experimental Inquiry, the treatments are carefully 



I am indebted to C. Ray Carpenter for this phrase. 



7 



designed beforehand, and one of the major purposes of the imposed controls 
is to ensure that treatment conditions vary as little as possible through- 
out the experiment. Such variation is seen as leading to an undesirable 
Inflation of the error estimate. In aexper imental inquiry, no such conditions 
can be imposed, and the treatments are likely to vary throughout the inquiry. 
Thus a new science teaching method being field tested will be subjected to 
almost continuous variation as teachers become more familiar with it, as 
their favorable or unfavorable attitudes toward it become firmer, or as the 
materials themselves are changed through extension and refinement. If ex- 
perimental treatments are fixed , aexper imental treatments are highly varia- 
* g » t>ut to the aexper imental ist, this fact is itself grist for the mill 
and deserving of study. 

6. Context . Experimental inquiries are, by virtue of the controls 
imposed, made essentially free of the context in which they are carried 
out; indeed, this lack of context is the major virtue of the laboratory. 

Aexper imental inquiries, on the other hand, are highly contextual in 
nature, the particular outcomes of any aexper imental inquiry depending 
heavily upon the context in which the inquiry was carried out. 

The preceding discussion differentiating experimental from aexper- 

Imental inquiry is summarized in Table I, for ease in subsequent referencing 
(see page 8) . 

The Nature of Educational Change 

Having thus delineated the nature of the basic strategies of inquiry 
which are available to an investigator, I shall take it as my problem to 
make a determination of which strategy has the most Immediate utility for 
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TABLE I 

ESSENTIAL POINTS OF DIFFERENCE BETWEEN EXPERIMENTAL 
AND AEXPERIMENTAL INQUIRY 



Area of Difference 


Experimental Inquiry 


Aexper I mental Inquiry 


Intent of the 
Invest igator 


Poss i b i j i t ies 


Actual i t ies 


Setting 


Laboratory 


Nature 


Level of 
Control 


Absolute* 


Invited Interference 


Scope 


Mo 1 ecu ! ar 


Molar 


Number of 
Var iables 


Limi ted 


Gross 


Treatments 


Stable 


Variable 


Context 


Unrelated 


Highly Relevant 



_This condition cannot be met In many experimental Inquiries 
for various reasons, e.g., inadequate resources or lack of 
access to an appropriate sample,, In such cases "quas I -exper I 
mental ' designs are often advocated "in tandem" so that defi- 
ciencies produced by lack of a certain kind of control in one 
design may be overcome by corresponding strengths in another 



students of educational change. I do not mean to imply by this state- 
ment that one of these strategies is always preferable to the other, or 
that any determination of preference which we may make at this historical 
time will always hold. Our immediate problem, however, is how to get on 
with the study of educational change now, with whatever level of sophis- 
tication that we may possess and in relation to any questions that in- 
terest us currently. I cannot proceed to this next step wi^Sdopting 
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for analytic purposes some conceptual paradigm of the nature of educational 
change, and I will therefore make a brief excursion to describe such a 
paradigm which I have found useful, and which was formulated In another 
context by my colleague, David L. Clark, and me.^ 

We see the process of educational change as involving four stages 
(although not necbSsarlly In a, particular order, nor always with all 
stages being Involved); research, development, diffusion, and adoption.. 

This continuum Is depicted In Figure I We believe that each stage has 
a particular objective; that whether or not those objectives are met is 
judged by the application of certain criteria which are different for 

each stage; and that each stage bears a particular relation to the change 
process. 

Let me make a few explanatory comments about the figure. 

I. Research is a process intended to advance knowledge.. It may 
provide the basis for an invention but need not be conducted with that 
end in view The appropriate criteria for judging research are internal 
— * g^e>'na_Lyal idi ty. It need not be of any particular import 

to the researcher whether or not his findings have any "pract i ca I' appi ca- 
tion, and to expect him to conduct research with the Intent of producing 
applications is to impose an Inappropriate expectation for his work. 

2. Development is a process which formulates a solution to an 
action problem (in^tjon) and which packages this solution or Invention 



explication of this paradigm is contained in our 
p per. An Examination of Potentjal Change Roles in Education " Symposium 

c2nler°for'?h.'cr'’a^'’'’r? . National Education Association 

Center for the Study of Instruction, Airlie House, Virginia, October, 1965. 
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for institutional use ( design ) . Development, not research, Is thus the 
pro-cess that actually produces and makes available an invention. Criteria 
appropriate to invention relate to judgments concerning its apparent 
validity for solving the problem it was intended to solve, its estimated 
viability In the real situation, and its probable impact, i.e., the rela- 
tive contribution it might make to the solution of the problem. Criteria 
appropr i ate tQ-. design i n,c I ude feasibility within an on go ing institution, 
general izabi 1 1 ty in the sense of utility In a wide variety of situations, 
and performance, i.e., how well does it get the Job done? Development 
may or may not be based upon research; it may be desirable to so base It, 
but perhaps this approach may not be practical, because appropriate re- • 
search is lacking or because available research is ambiguous or incomplete. 
Such lacks exposed during the development phase are of course useful in 
identifying further needed research 

3. D i ffus ion is seen as a process for informing persons about the 
existence of an invention ( disseminat ion ) and for building conviction 
about its utility on the basis of appropriate professional evidence 
(demonst ration ) Criteria suitable to dissemination include intelligi- 
bility (is the information clear?) fidelity (does the information pre- 
sent a valid picture?) pervasiveness (does the information reach all of 
the intended audiences?), and impact (does the information affect key 
targets appropriately?), Demonstrations, to be effective, must be cred- 
ible, convenient, and provide opportunity for professional assessment of 
evidence, both positive and negative, concerning the utility of the in- 
vention being demonstrated. This criterion of evidential assessment is 
crucial for the aim of demonstration is not to huckster a particular in- 
vention but to open a further alternative for professional consideration. 









4. Adopt ion Is a process for trying out, fitting to, and establishing 
an Invention as part of an ongoing program,. A trial period Is concerned with 
testing the invention In the particular setting In which it may eventually be 
Installed; criteria appropriate to it are the adaptability, the feasibility, 
and the action of the invention In that setting. An instal lat Ion period is 
concerned with fitting the charact€;r 1st Ics of the Invention to the character- 
istics of the adopting institution, a complex process that may require exten- 
sive redesign, personnel retraining, etc.; criteria appropriate to It include 
the conventional administrative criteria of effectiveness and efficiency. 

Inst I tut lonal l 2 at Ion period Is required to assimilate the Invention to- 
tally, i.e., to convert It Into a "non-Innovat Ion"; criteria appropriate to 
it include continuity, the degree to which the Invention is valued, and the 
support given to It by the local setting, 



The Selection of a Methodological Strategy 

Given the preceding formulation of the change process, we are now in a 
position to make a choice between experimental and aexper Imental strategies 
for studying educational change. We may begin by noting that this formulation 
opens two broad areas of Inquiry to us, which I shall term change research and 
evaluat ion. Change research Is concerned with the entire process, the entire 
content of Figure I, so to speak. It may investigate the necessity and suffi- 
ciency of the formulation, of the contribution made by each phase, of the methods 
and agencies that Interrelate and articulate the phases and the means used *n 
carrying them out; in short, the whole gamut of inquiry as described In Bhola's 
paper. Evaluation, on the other hand, is concerned with single phases; It asks 
whether. In relation to any particular Innovation, the objectives have been met; 
whether, for example, a particular design is genera I izable and performs well. 
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or whether a particular demonstration Is credible and based upon evidential 
assessment . 

Which Inquiry strategy seems, at this time and under present conditions, 
best equipped to deal with change research and evaluation, when seen In terms 
of the conditions outlined In Table I? Let us consider the two areas of 
inquiry separately. 

I* Change research . Most existing change research has been carried out 
in relation to real situations: adoption of hybrid seed corn by the farmer, 

spread of a particular drug in the medical profession, and the like. Broad 
classes of variables such as change agents, change mechanisms, characteristics 
of innovations, characteristics of early adopters, etc., have been identified 
and used. But it is clear, particularly in view of Bhola's excellent summary, 
that change research is in its ihfancy; no generalized systems of variables or 
theories have emerged. If the particular virtue of the experimental approach 
is that it permits the Investigator to bear down hard on a few selected vari- 
ables known to have high relevance, the utility of the method is questionable 
in this area where the general level of sophistication is so low. I believe 
it is fair to describe the situation in relation to change research as 
follows, using the terms of Table I: 

Intent of the Investigator: Possibilities, but with 

practical considerations having forced the 
examination of actualities. 

Setting; Nature. 

Level of Control: Efforts made at control but with a 

great deal of confounding evident. 

Scope: Molar, although becoming more molecular as 

sophistication increases. 

Number of Variables: Large, although not gross. 

Treatments: Variable, although in some areas stability 

is beginning to emerge. 

Context: Still quite relevant. 
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Under these circumstances, the power of the laboratory approach must 
be considerably diminished. It Is my conclusion that aexper imental methods 
are now most appropriate to change research although experimental methods 
will be increasingly employed and should be utilized as interest of inves- 
tigators i nd i cates the i r use and conditions make their use possible. 

2. Evaluation . Evaluation is a fairly well developed science. It 
Is no longer viewed simply as a means whereby certain baseline data are 
compared to performance data In order to ascertain overall performance; 
instead, it has become increasingly useful as a tool for process control 
and as a steering mechanism to make adjustments and refinements long be- 
fore the final performance data are in. The systems concept has gained 
sharp ascendancy, and evaluations are related very directly to the par- 
ticular situations in which they are carried out. In the terms of Table I, 
the situation with regard to evaluation may be described as follows, in my 
judgment: 

Intent of the Investigator; Actualities. 

Setting: Nature, 

Level of Control* Invited interference. 

Scope: Molar. 

Number of Variables: Gross. 

Treatments: Variable. 

Context; Highly relevant. 

In short, the evaluation process fits exactly the conditions described 
for aexper imental inquiry. While in the case of change research we might 
wish to argue that increased sophistication will make possible more experi- 
mental inquiries over time, it seems unlikely that the interest of evaluator 
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will tend toward experimentation. This is not to deny that experimental 
techniques have no place here, but simply that they are not the major tool. 
So for example, while an automobile manufacturer intending to develop a new 
carburetor for use on his product may subject prototype carburetors to lab- 



oratory experimentation to make determinations about design specifications, 
his major interest is in whether that carburetor will work on real cars in 
real situations. Similarly, components of an educat ional invention may, 
particularly in the design stage, profit from study under laboratory con- 
ditions, but the final and most meaningful evaluation must be made in the 
field with intentions and under conditions that make the aexper imental 
mode most meaningful. 

It is therefore my considered judgment that both in the case of 

k 

change research and evaluation, the aexper imental approach is at present 



most meaningful, and I urge it upon you as the preferred strategy, at least 
at this time. Since the term "aexper imental inquiry" seems somewhat pedantic 
for everyday use, I suggest that we refer to this general approach as a 
"field study" or "field investigation," in view of the fact that this strategy 
deals primarily with actualities in natural contexts. I will use the term 
this way throughout the remainder of this paper. 



Some Illustrative Tactics for Field Studies 



An immediate and somewhat disquieting consequence of my recommenda- 
tion that we adopt the field study approach is that the methods and tech- 
niques that have been developed for experimental inquiry are inappropriate. 
One may well ask whether the recommendation is in fact feasible and viable 
(to use my own criteria), in view of this fact. I shall therefore devote 
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the remainder of this paper to a description of certain techniques which 
are illustrative of how the strategy may be pursued, we may think of these 
illustrations as tactics designed to carry out the strategy: 

The suggestions that I will make must be understood against the back- 
ground which I sketched earlier regarding the nature of field studies, and 
particularly, their unique characteristics, ( take it for granted that we 
shall, in every field study, make every effort to collect a baseline of data 
about the situation, because the contextual nature of field studies makes 
this necessary if reasonable Interpretations of data are to be possible I 
shall further take it for granted that the methodologies must be largely 
non - i nter ven t ion i s t , to satisfy the requirements of aexper < mental inquiry. 
Finally, I shall assume that field studies will always involve collect ic^ 
of data on a large number of variables, recognizing the molar, multi- 
variate nature of such inquiry, 

I shall not spend any time discussing the fact that field study meth- 
odologies are already available in a number of substantive areas.. hl.-j 
methodological survey Bhola repeatedly mentions the research traditi n i- 
such areas as sociology, anthropology, psychology, psychoanalysis, economics., 
and common i cat ions „ Obviously,, each of these traditions will have something 
to contribute, and we can profit by studying their methods, I shall refrain 
from reviewing these standard approaches since they are generally available 
In the literature. Instead, I will get some of my more woolly ideas «,>ut in 
the hope that you will demolish them, and so get them out of the way once 
and for all, or help me to refine and enlarge them. The suggestions follow. 

1” field studies must be approached programmatically b ecause •. *f their 
complexity and molarity ., The field investigator cannot observe everything. 
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how is he to know what Is relevant? I submit that a systematic development 
^ of the objectives of the inquiry adequately placed within an appropriate 
theoretical framework is the only defensible approach except in the most 
simple cases. 

What do I mean by a programmatic approach? I believe I can best make 
this clear with some observations on the nature of inquiry objectives,^ 

Now every objective which can be stated for an inquiry consists of 
(1) an action aspect and (2) a content aspect . Thus, for example, an 
evaluation study might pose the objective, "To determine the effect of 
P$SC materials on science achievement." The action aspect is represented 
by the phrase, "to determine," while the content aspect Is the "effect of 
PSSC materials on science achievemento" 

Any given study is likely to have several objectives. It is pos- 
sible to display the objectives in tabular form if each objective is first 
broken into its action and content aspects, and a two-dimensional table 
is then formed whose rows are defined by the action aspects and whose 
columns are defined by the content aspects „ 

Clearly the content aspects of a study depend on the substantive 
field which is being investigated, in my example, PSSC materials.. But 
is it also true that the action aspects will depend upon the particular 
substantive area? if so, we have gained nothing by the tabular represen- 
tation. But suppose that a set of terms could be developed about which „ 



The discussion which follows is drawn from the paper, "Types of 
Educational Research," by Egon G. Cuba and Oavid L„ Clark, Chapter IV 
in William J. Ellena (Ed.), Research and the School Administrator , 
Washington, D.C.: American Association of School Administrators, in press. 
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we might assert with some confidence that all possible res ea rch acti ons are 
represented therein? If so, one might project for any given substantive area 
all possible inquiry objectives, by linking the general classification system 
for action aspects with particular classification headings appropriate to the 
substantive field which is under investigation. 

Unfortunately, such a generic classification of action objectives can- 
not be directly generated, but there does appear to be an intuitive solution 
to this problem which can subsequently be tested empirically. The four verbs 
(1) depict, (2) relate, (3) conceptualize, and (4) test, appear to account 
for all action aspects which might be postulated for any study. 

This classification of action aspects was derived intuitively from 
the following reasoning An investigator dealing with a hitherto uncharted 
area is at a considerable disadvantage in studying that area. He has no 
preconstructed framework to guide his inquiry; about all he can do is make 
random observations, recording what he sees. Much of what he sees he will 
be able to depict in qualitative form only; but in some cases he will be 
able to make rudimentary measurements, counts, or ratings.. Such operations 
can be designated with the generic term dep i ct , and this depiction can occur 
in two ways; qualitative and quantitative The term descr i be can be used 
to indicate qualitative depiction and the term est i mat e to indicate quanti- 
tative depiction 

An area well depicted is subject to a different strategy of inquiry 
Entities within the area may be related to one another or to entities out- 
side the area. Again such relating may take quantitative or qualitative 
form. The generic term r elate will be used to indicate this operation. 
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and the terms compare and correlate to indicate the qualitative and quan- 
titative aspects of this operation. 

Once relationships are established, it is possible to develop con- 
cepts about an area. Entities and relationships may be studied to determine 
groupings or classes Out ot these basic classes of entities and relation- 
ships may emerge theoretical conceptions, systems, parad igms , or model s . 

The generic term conceptual ize is used to mean the general process of attach 
ing meaning to entities and relationships The term analyze wi 1 1 indicate 
the abstracting or categorizing aspects, while the term s ynthes i ze will in- 
dicate the developing, constructing, or theorizing aspects 

Finally, given taxonomies or theories, we may return to the phenom- 
enological levels of depicting and relating to test . The operations or 
processes involved in testing the conceptual formulations may be indistin- 
guishable from the operations or processes involved in depicting or relat- 
ing, but it is clear that their purpose is vastly different. 

The categories of the action taxonomy here proposed are summarized 
in Table 2 which in addition to the major and minor terms already mention- 
ed contains a series of synonyms intended to help grasp the meaning intended 
at each level . 

The proposed system outlined in Table 2 appears to have a number of 
advantages for programmatic planning- 

1. The taxonomy when applied to an area of inquiry 
circumscribes the possible objectives which may be. 



undertaken , 







) 

/ 

V 









m0A0M^*k.^%^ m>*itfr<^:trM^'^'T ^Jy*9M.%\A\f,w^:^- ^ 






20 



TABLE 2 

GENERIC CLASSIFICATION OF ACTION ASPECTS OF INQUIRY OBJECTIVES 



Major 

Terms 


Minor 

Terms 


Svnonvms 


Depict 


Descr i be 


identify, define, distinguish, 
determine.^^ limit 




Estimate 


appraise, rate, count, rank, 
measure, standardize, norm 


Relate 


Compare 


liken, contrast, collate, match 




Correlate 


connect, associate 


Conceptual ize 


Analyze 

Synthesize 


examine, categorize, abstract, 
reduce 

prepare,, develop, construct, 
systematize, compose, assemble 


Test 




evaluate,, confirm, resolve, 
demonstrate, substantiate, 
ver i f y 



The investigator is forced to assume a logical 



framework or theory to help him develop a provisional 

*' ’ 

set of content columns, which he can improve as his 



sophistication increases 

3- The investigator must make a consci«ous choice of 
the particular objectives which he will follow on the 
basis of explicit criteria relating to the objectives. 

I would suggest that this approach will permit an investigator to 
outline in some detail just what it is he will do. within what theoretical 
or logical fr amework he will do i t ~ and i n what order., 
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2* Field studies must be conducted within an explicit theo reticgl 
21 — Logical framework. It Is obvious that the programmatic approach pro- 
posed In the previous section will not work unless appropriate labels, 
drawn from some theory or logical framework^ can be applied to the columns 
of the objectives matrix. Where does this theory come from? Now II would 
not like my suggestion to immobilize all field studies while appropriate 
theories are being developed; we must obviously start from where we are. 
Even the most simple categories will do at first, for it is obvious that 
the process implied by Table 2 is cyclical in nature. However incomplete, 
naive, or even wrong the theoretical categories may be at the start, the 
processes of depicting, relating, conceptualizing, and testing will lead 
to improvements and refinements; these improved and refined formulations 
can then be used to generate new column headings which make possible more 



sophisticated and refined study.. 

A simple answer then to the question of where the theory will come 
from is to reply, from where we now are. For example, the headings from 
the Clark-Guba change paradigm in Figure 1 give one kind of start. The 
list of common generic variables that seem to be widely found in the change 
literature, e.g , change agents, change mechanisms., target characteristics, 
innovation character istics, etc., is another Chin's taxonomy of innovatio 
types, i.e., substitution, alteration, perturbation and variation, restruc- 
turing, and value orientation change, is another.^ Many other examples 
could be cited, most already noted in Bhola's summary of research. 



Robert Chin, "Models and Ideas about Changing," paper presented at 
the Symposium on "Identifying Techniques and Principles for Gaining Accept- 
ance of Research Results of Use of New Media in Education," Lincoln: 
University of Nebraska, November, 1963 



A more sophisticated answer to the question of where the theory is to 
come from is to suggest that it be systematically generated, j wr>uld refer 
you here to the work presently being conducted at The Ohio State University 
by my colleagues,, George and Elizabeth Maccia, who are pioneering in what 
they call the retroductive generation of educational theory through the 
use of theory models from other fields. Briefly, the process involves 
the identification of an existing and productive theory in another field. 
e.g.„ graph theory from mathemat ics or general systems theory, and in 
effect translating this theory Into educational variables and processes 
to yield testable hypotheses about education., We may say., for example, 
that the processes of learning are analagous to the processes of visual 
perception, and since we know a good deal about visual perception., the 
laws, theories, and hypotheses of visual perception may, after proper 
"translation," serve, subject to further empirical test, as laws theories, 
and hypotheses of learning. I would recommend a thorough study ..if the 
Maccias' work to any serious student of the change process. But let me 
emphasize that I do not believe that the existence of highly sc ph i s t ’• cated 
theory is a necessary precondition to beginning work, it is rather a goal 
toward which we may work. 

^ collect ion in Field studies is characte r ized by a ur i gue 

LgJ.gt'«--"Ship betw een the investigator and the phenomeno 1 i caj^ f i ej_d 
This statement represents, in my judgment the most important single 
tactic that I can describe in relation to field studies., Perhaps the 
best way that i can explain what i mean is to contrast the behavior .;f 
the typical laboratory investigator with that of the typical field in- 
vestigator. The laboratory investigator is intent on manipulating 
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relatively few variables, with rigorous controls established for all others 
The unwanted character of these other variables is indicated by the fact 
that they are termed "confounding" variables, and I am sure that the lab- 
oratory investigator often tends to think of them as "confounded" variables 
At any rate, he sets an experimental design to control them, and the design 
is also selected to yield a particular information estimate that the in- 
vestigator happens to be interested In When everything is set, the lab- 
oratory investigator figuratively presses the "Go" button, and then stands 
back to let the experiment run. At the end he collects his already cate- 
gorized data and analyzes them according to the design he has had in mi rid 
all along., If the confounding variables got a bit out of band he curses 
silently, vows to build in more rigor next time, and reports his find'ogs 
in ways designed to diminish the importance of h i s obvious ly ir\flated 
error estimate. 

The field investigator is not, similarly, at the mercy of his data. 
Changes in conditions do not alarm him indeed, he expi-’Cts them, and fully 
intends to capitalize on them,. Whenever changes occur he is there to note 
them, to make whatever shrewd guess he can about why they occurred, to 
estimate as carefully as he can the<r effect, and to establish a new base 
line, as it were, for subsequent data collection. He rolls with the punch, 
he is on top of thmgs, he is ret afraid to work with the data because ne 
need not fear that to do so wMI destroy the careful balance of his experi- 
mental controls. 

Let me give two examples of how the field investigator car'i accomplish 
this dynamic role. My first example relates to a project wh^ch Dr Sidney 
Eboch and • have currently under way, and which is designed to determine 
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the effects on a school of the maximum availability of films and filmstrips. 
Four schools throughout the country have been provided with a wide variety 
of films and f i Imstr ips--something over 500 films and 1000 f i Imstr ips--to- 
gather with the necessary projection devices, room darkening screens, etc. 
Our purpose is to gather certain data on the process of adjusting to this 
bonanza and to determining the effects of the program on student achievement 
teacher curricular adjustments, and a wide variety of other variables. 

Now we know from previous research on media that we can expect a 
particular utilization curve to manifest itself if we plot film use, sayp 
against time. The typical form of the curve is shown in Figure 2. At 
first, we get a sharp rise in film use as compared to the base rate typical 
of the school before the project was begun. This rapid acceleration con- 
tinues for some period of time, then, suddenly, we reach a point of in- 
flection, A, at which the curve begins a sharp deceleration. After a 
further time, at point B, the curve begins to level off and to asymp- 
tote to a final normal use rate. 




T ime 

Figure 2 - Curve of Film Use Against Time 
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If we have been plotting these data systematically we can become 
aware very quickly when points A and S put In an appearance. Now Is 
the time, the field investigator cries, and he Is off with all of his 
observational and Interview techniques to find out what Is going on. 
What are people thinking about? Why are they suddenly surfeited at 
point A? What Is the nature of the routine Into which they settle at 
point 

Clearly this technique of continuous time analysis of data for 
the sake ’of exposing crucial events and decision points can have great 
utility. The investigator may not know what to expect; he may not know 
when to expect it; he surely has not arranged It through experimental 
treatment definition; he has not controlled any of the possible sources 
of interference. Yet he can identify a crucial phenomenon and pursue 
it with whatever techniques seem appropriate. 

I should also like to point out that, although in my example • 
began with a certain preknowledge of the form of the curve that I 
might expect, this preknowledge is not a necessary condition for the 
application of the technique. Plotting use data against time in Ig- 
norance of typical use curves would still have produced the curve, 
and the Investigator could still have made Interpretations that crucial 
events were occurring. 

My second example is concerned with what is sometimes called link- 
age analysis. How, for example, does a creative use of films in class- 
rooms that may have been invented by a particular teacher spread to 
other teachers? Where did teacher X hear about it? How did she learn 
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enough about It to be able to utilize It herself? What Is the chain by 
which the Innovation spreads from Its Inventor to all of the other teach- 
ers In a building, and perhaps to teachers elsewhere as well? 

Here a technique of retrogressive Interviewing may be In order. 

We may find that the "chain*' along which the Innovation spreads corre- 
sponds, say, to the sociogram of Informal social contacts among teachers. 
Again, the important point lo note Is that the Investigator does not 
wait for the data to come to him; he goes after them wherever they may 
be found. In contrast to the relatively passive laboratory investigator 
who pushes the "Go" button and then sits back waiting for things to 
develop, the field Investigator Is constantly on the go himself, relat- 
ing to the phenomena, fitting, shaping, matching until Insights emerge 
and the basic patterns are nailed down. 

of the probabal 1st Ic nature of field data, and the 
i mpressionistic way that these are gathered, constant replication and 



jlgcyclinq are necessary to b uild confidence In conclusions Th i s t ac t i c 
might be called the tactic of accumulative evidence . Now we all know 
that the flip of a com Is a singularly unreliable event in that It Is 
entirely a random matter whether a head or tall comes up. But suppose 
that we have tossed the coin twenty times and find on each occasion 
that a head turns up. Now such an outcome is, of course, possible under 
random circumstances. If one tosses a coin often enough, eventually a 
run will occur In which twenty successive tosses come up heads. Yet 
this event is so rare that If you were to toss a coin with me right 
now and have a run of twenty heads, ( would be strongly inclined to 
believe that the coin was biased In some way or that you were 
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manipulating it in some way while you were tossing it. If you should in- 
crease that run to twenty-five or thirty straight heads, I should be al- 
most certain of that conclusion. 

Many of the methodological problems in the social sciences have 
been foisted upon us by an almost slavish emulation of the methods of 
the physical sciences, but one of those methods, which we for some 
strange reason have decided not toadopt, is that of replication. No 
principle in the physical sciences was ever conclusively established - 
by the critical experiment of a single investigator. So for example, 
when Michelson published his .classic paper concerning the precise de- 
termination of the speed of light, many other physicists immediately 
set up similar apparatus and replicated or repeated Michelson's experi- 
ment for verification. It was not considered de classe by other physi- 
cists to replicate the experiment and to publish it and indeed, the 
physics literature of the time contains reports of many such replica- 
tions. in the social sciences, it seems to militate against the rep- 
utation of an investigator to repeat the work of another, but it is 
obviously through such continuous repetition and recycling that com- 
plete confidence in the validity of a result is built up. This must 
be especially true in an area such as field studies in which the 
data which result from any particular single study are likely to be 
more unreliable than we would really like. The method of accumula- 
tive evidence is one that ought, therefore, to appeal especially 
well to us . 

Jn applying this tactic vre may also borrow a useful 
from.Campbel 1 and Stanley, who make the following point. 



notion 
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. . . the more numerous and independent the ways in 
which the . „ . effect is demonstrated ^ the less numerous 
and less plausible and singular rival Invalidating hypoth- 
esis becomes. The appeal is to parsimony. The "validity" 
of the experiment becomes one of the relative credibility 
of rival theories: the theory that X has an effect versus 

the theories of causation involving the uncontrolled factors 
If several sets of differences can all be explained by the 
single hypothesis that X has an effect, while several sep- 

*®**"''*'^'®*^*® effects must be hypothes ized^ 
a different one for each observed difference, then the 
effect of X becomes the most tenable.® 



Campbell and Stanley's observation was of course Intended to apply 
to experimental situations In which quasi-designs were required because 
of the experimenter's Inability to meet all necessary control requirements, 
but are nonetheless true also for field studies. To' the extent that field 
studies can be conducted In overlapping "styles - (I intend to use the term 
styles" here as roughly analagous to the experimental term "designs") the 
effects of particular variables can at least be probed, even if not defini- 
tively established. If styles, like quas i -des i gns, are selected so that 



the weaknesses of one are matched by the strengths of another, reasonable 
inferences can be made. 



analagous to a "treatment" in the cl a ssic design sense althn.iqh It may 
not have been introduced by the investigator and hence is not an int»r . 
^ t_ ion in the usual sens e. Under such circumstances. guasl-desi.|ns are 
useful and may be applied , dues i -designs of the types proposed by 
Campbell and Stanley are intended to serve as substitutes for true de- 
signs in situations where all relevant variables are not under the experi- 
menter's control. That is, these designs were originally intended for use 
in connection with experimental or laboratory inquiry, and each of these 



i . f n • ’’r® ' "Experimental and Quasi- 

(Ed I Ha^dho^!*T» Teaching," Chapter 5 in N. L. Cage 

of Research on Teaching Chicago: Rand McNally and Co 
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designs contains an X factor or treatment condition imposed by the inves- 
tigator, At times, however, the X may not be imposed from the outside 
but may naturally emerge in the situation, as for example, when certain 
administrative constraints may be placed upon the use of films and film- 

«r. 

Strips by teachers in the project that I cited earlier. These constraints 
. in effect form a treatment condition that may materially affect the uses 

that teachers make of the available media, and the field investigator may 
wish to determine the effect of these constraints^ Stanley has suggested 
that under these circumstances the design which may be diagramed (using 

the notation of the Campbel 1 -Stanley chapter already cited) as follows 
has ut i 1 i ty r.^ 

I 

9u..02.; 

|03 K O 4 

0 ] and 02 refer to observations made at a previous similar time 
interval (eg,, the previous school year), and while 0 ^ and 0 ^ are observa- 
tions made currently, with X, the emergent variable of interest simulat- 
ing a treatment variable being juxtaposed,. The dotted horizontal line 
reminds us that the two groups on which the observations are made may 
not necessarily be parallel or equivalent groups. The effect of X is 
estimated by comparing (0^ - 0^ ) with‘(0^ - 0^ ). This design is 
subject to a number of threats to validity, which I shall not review 

here but which are discussed in some detail in the Campbel 1 -Stanley 
• chapter.*® 



Q 

Julian C. Stanley, "(iuas i -Exper imentat ion in Educational Settings." 
Conference on Novel Strategies and Tactics for Field Studies involving 
New Educational Media, The Ohio State University, Columbus. May. 1965^ 

*®Campbell and Stanley, op c i t . I 78 . 
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The major threat to this design, history, that is. random time 
related effects, can be considerably reduced, according to Stanley if 
It is possible to add several control groups, one within and one out- 
side the experimental school. The design may then be diagramed as 
fol lows . • • 



9 l- - - _ 92 - J _ 93 _ 94 _ Experimental 

• O5 X Og School 

67 Oq" 1 " 6« 6 “ Control School 

7 8 ^9 ^10 



(O2- Oj) - ( 0 ^ - O3) affords an estimate of the history effect 
within the school; this estimate may be compared with that derived from 
the comparison (Og - O7) - ( 0 ,q - O9) . the history effect in a control 
school. O3 O5, and O5 should be similar as possible to afford group 
comparability The effect of X is of course determined as before, except 
that multiple comparisons are now possible. (Og - O5) may be compared 
with (O2 - 0 ,), with (O4 - O3), with (Og - O7) and with ( 0 ,o - O5) . 

Jhg. Cact that expe rimental control is not possible or even 
necessarily desirable in field studies does not mean that the investi - 
a ator is forced to use just a n y samples or situations . Purposeful 
R eject ion _ is a pow erful tool in focusing upon variables of i nterest 
— the investigator We have now repeatedly made the point that field 
studies cannot be conducted in conformity with the conditions of control 
required by classic experimental approaches. Indeed, the requirements 
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of classic design for samp I ing (which you may recall requires both random 
selection of subjects and random assignment to treatments) are also typi- 
cally not met. But the fact that these conditions are not met should not 
cause us to throw up our hands and simply use any situation or any sample 
which happens to be convenient. Rather we have the option of selecting 
situations and samples with a view to achieving maximum differentiations 
of the factors in which we happen to be interested. Let us suppose, for 
example, that we have developed a new course in biology which we wish to 
try out. We are well aware of the fact let us say, that different teach- 
ers will regard this biology package with different attitudes. Some teach- 
ers whose training in biology may be rather poor may very well welcome the 
package as a way to assure themselves that' they will conduct their classes 
at least at a minimum level of quality Other teachers may feel that the 
use of such course materials prevents them from exercising their own in- 
genuity and initiative with regard to teaching the course since they must 
slavishly follow the outline as it has been developed 

Now we could try out this biology course in a series of convenient 
schools, and we might quite by accident, uncover teachers who hold these 
different attitudes, ft might then be possible to make some statement 
about the interaction of these attitudes with the use of the course mate- 
rials. On the other hand, it is equally likely that if we select a con- 
venience sample, groups sharply differentiated on this attitude will not 
be identifieo and information with regard to the interaction of attitude 
and utility will be unavailable. We can insure the availability of such 
information by the way in which we select our sample, however. Obviously, 
we could select as one of the schools in which the materials are to be 
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tried, an upper socio-economic level school which has the resources to hire 
excellent, wel 1 -exper ienced teachers who are likely to set high store upon 
their own ingenuity and creativeness; and select as another school, one which 
has a faculty that can be identified as relatively unimaginative and uncrea- 
tive in its approach to teaching. By such judicious selection of the sample, 
we can get at least a partial reading on the relationship of attitudes to 
utility which might not otherwise be available. Obviously, ,1 am not suggest- 
ing that such a design will permit absolute cause and effect statements; I am 
suggesting that under the typical conditions of field studies, such an ap- 
proach is more likely to yield useful information than is an approach which 
does not take advantage of naturally occurring differentiations. 

7. Special techniques of analysis and interpretation need to be devel - 
oped which are especially suited to the data produced by field studies . Many 
of these special techniques may be deduced by analogy to similar techniques 
i n related areas . Certain other areas of endeavor, while not faced with 
methodological problems identical to those which face the field investigator, 
have nevertheless developed useful ways of handling the same kinds of data 
which he usually collects. So for example, much of the data that the field 
investigator obtains are based upon the testimony of persons: teachers, 
pupils, administrators, parents, and others. Such testimony is usually 
dismissed by classic experimentalists as worthless because, as they say. 
it is highly subjective, influenced by Hawthorne Effect, distorted by the 
participants into a self-fulfilling proph 3 cy, and the like. Yet, there 
exists an analogous area in the courts, whose operations and whose Judg- 
ments ,.re very often based upon testimony. Over the years well developed 
principles of evaluating testimony have emerged; thus, we are all familiar 
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with the fact that hearsay evidence is inadmissible, that eyewitness testi- 
mony is preferable to circumstantial evidence, that expert witnesses may 
have their opinions regarded by the court as literal fact, and so forth, 

Is it possible that through an examination of the "rules of the game" estab- 
lished for testimony in the courts we may deduce some methodological prin- 
ciples which will have utility for us in weighing the testimony of partici- 
pants in field studies? 

Another form in which the data of field studies often comes is that 
of judgments made in observational situations„ Other analogous areas exist 
in which judgments based upon observation have been developed into a fine 
art. So for example, artists have learned to make judgments about paintings, 
musicians have learned to make judgments about "the innate talent" of other 
musicians whom they hear perform; schools of speech have learned to develop 
debate judges whose opinions regarding the relative quality of various debate 
teams are highly reliable and valid; athletic departments have learned to 
make judgments concerning athletic performance; schools of agriculture have 
learned to train stock-judging teams whose judgments about the quality and 
carcass weight of an animal examined on the hoof are remarkably reliable 
Is there something to be learned by studying the methods used in these analo- 
gous areas? A third analogous area is that of the developmental case study 
Particularly m recent years the literature of a number of fields^ particu- 
larly the military, have contained reports concerning the development of 
some particular project, as for example, the B-70 bomber. Intricate case 
studies of various phases and aspects of the development are p.eced together 
to give a very coherent picture of the process by which the final end product 
was achieved- Again, we see the utility of such detailed case studies in 
relation to educational field studies. 
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There are obviously other analogous areas which could be mentioned but 
my purpose here has been to be illustrative rather than exhaustive. Clearly^ 
these analogous areas should be extensively studied for clues for the develop- 
ment of field study methodology. 

8* A most important tactic in planning field studies is to lean more 
heavily upon logical inference than upon statistical inference . I t has been 
common in previous field studies to set only the most simple minded hypotheses 
for test but to depend upon an elaborate statistical approach in reaching 
conclusions. We have now repeatedly made the point that field studies cannot 
meet the assumptions of classical systems and design, nor indeed, do we want 
them to. To rely heavily upon the statistical treatment thus, seems to be 
the height of folly. This folly is well documented by the fact that so many 
of our field studies have resulted in inconclusive findings. The most readily 
available example that I can think of is the large number of field studies 
that have been conducted in relation to the effectiveness of educational tele- 
vision. Repeatedly we have tested the weakest possible hypotheses, to wit, 
can television teach as well as "conventional methods?" Over and over, our 
statistics have forced us to the same conclusion: there is no significant 

difference between teaching by television and teaching by conventional methods.. 
indeed, researchers in this area have formed themselves into the N.S.D.. Club, 
i.e,, the No Significant Difference Club, because of the freguency with which 
this finding occurs, I would suggest that the fault here lies not with any 
innate deficiency in the field study approach but rather in the weak hypothesis 
which the field study is intended to investigate.. We have surely not exhausted 
the logical processes of which our minds are capable in producing hypotheses 
at this level . 
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What seems to me to be a more rational approach is to imagine every 
alternative outcome that might result from the particular field test that 
we have in mind, and then take steps to see to it that these possible al- 
ternatives are systematically ruled out if they are invalid but retained 
If they are valid. This approach has been clarified by Platt In an in- 
teresting recent article which I urgently recommend as reading to anyone 
interested in this area. 

Platt suggests a return to classic Baconian research and proposes 
the following steps, 

1. Devising alternative hypotheses-as many as the investigator 
can imagine. 

2. Devising crucial experiments with alternative possible out- 
comes, each of which will, as nearly as possible, exclude one or more 
of the hypotheses , 

3. tarry out the experiment so as to get clean results. 

Recycle the procedure, making sub-hypotheses or sequential 

hypotheses to refine the possibilities that remain. 

Platt's advice will need to be adapted to field studies. .;f c.)„rse. 
to take account of the fact that laboratory experiments are not possible 
within this rubric, but systematic and pointed observations are. We can 
certainly take a leaf from his book when he says 

inference, and the logical tree it generate*, 
are to inductive reasoning what the syllogisir. is to de- 

® regular method for 

as raD?di*^"^” one after the other 

as rapidly as possible. 
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9 • Another strategy which We can employ is to take as much a dvan - 
tage as possible of serendipi ties, or ‘‘natural breaks .** To use again my 
example of a new course in biology^ let us imagine that the schools in 
which these materials are to be used have agreed to a three-year fieid 
testing period. During that time many changes will occur in the school. 
Some of these will be related to the biology course and others will not 
So for example, it is conceivable that during that three-year period 
there will be some turnover of teachers that will make it possible for 
us to contrast the attitudes and methods of teachers who have been using 
the material for some period of time with the attitudes and methods of 
teachers who are being exposed to it for the first time^ It is unlikely 
in a typical field study.., that we could exercise enough control over the 
situation to cause such a circumstance to occur by design^ but there is., 
of course, no rule of the game that prevents us from taking advantage cf 
this happy circumstance when it does occur. Other changes which occur 
naturally can similarly be taken advantage of. 

1 0 A final suggestion that I might make i s that we utilize the 
classic technigue of analyzing pathologies to gain insights into n a ture I 
s i tuat ions . i should like to draw an analogy here to psychoanalysis as 
a technique for gaining insights into the dynamics of the human person- 
ality. Freud in his early days faced a problem similar to that of the 
field investigator in many ways; he could not control the objects of 
his study, he could not experimentally manipulate variables, he could 
not intervene; he had to take his subjects in a naturalistic setting 
No one would argue that his patients were in any sense representative 
of the population at large in terms of personality or emotional variables. 
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Yet analytic techniques directed at an understanding of the pathology 
exhibited by his patients proved to be the sword point by which Freud 
was able to pry open the oyster of the human personal ity» Had he 
asked vJiat was right rather than what was wrong about his patients^ 
his insights would have been much less incisive^, I am sure. 

I am suggesting that we take a similar tack in managing field 
studies. Things that go right are not likely to be very useful in 
understanding the dynamics of change, but things that go wrong may 
very well result in penetrating insights. Field studies that turn 
out "badly" because of situational or organizational pathology may 
in many ways be as important as those that turn out very well indeed. 
Our mistakes are as instructive as our successes, and deserve as care- 
ful an analysis. 



Finale 

I have taken you on a rambling tour cf some as yet Ill-formed 
ideas concerning the "new methodology" of field studies This meth- 
odology is philosophically, intentionally, and technically vastly 
different from conventional experimentally methodology, as ( have 
tried to show It is not a poor imitation of research but an en- 
tirely different kind of inquiry. 

'1 

Unfortunately, as is plainly evident from the unfoccssed 
j nature of my remarks the "new methodology" is by no means sys- 

tematically explicated. This task awaits the careful attention 
of methodologists more competent than i to give it rigorous form. 



MMWIKW 



o 



38 



% 






» hope, however, | have been able to give enough examples of forms which 
It might take to evoke in you confidence that these methods have promise, 
It IS very clear to me that some new approaches must be developed and 
tried, if we are to meet the demands of the next decade adequately, if 
I have not convinced you of the utility of my particular suggestions, ( 
trust that I have at least given you cause for concern regarding conven- 



tional strategies, 
of my purpose wi I I 



If * have planted a festering doubt, more 
have been accomplished.. 



than ha^f 
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